Update gemma3 to use openvino genai #3075
Conversation
- Replace transformers library with openvino_genai for better performance - Update model loading to use OpenVINO GenAI pipeline - Modify gradio helper to work with OpenVINO GenAI streaming - Simplify inference code and remove unnecessary dependencies - Improve image processing for OpenVINO GenAI format
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
|
View / edit / reply to this conversation on ReviewNB aleksandr-mokrov commented on 2025-09-26T11:39:23Z Line #6. %pip install -q "git+https://github.com/huggingface/[email protected]" --extra-index-url https://download.pytorch.org/whl/cpu We can update it the transformers. The 4.55.4 version has the support of gemma3 |
|
View / edit / reply to this conversation on ReviewNB aleksandr-mokrov commented on 2025-09-26T11:39:23Z Line #3. Comment it please |
|
View / edit / reply to this conversation on ReviewNB aleksandr-mokrov commented on 2025-09-26T11:39:24Z Line #5. #if not model_export_dir.exists(): Uncomment please |
|
View / edit / reply to this conversation on ReviewNB aleksandr-mokrov commented on 2025-09-26T11:39:25Z Line #13. image = load_image(image_file) It doesn't work if you don't have a downloaded image. |
ezelanza
force-pushed
the
update-gemma3-openvino-genai-clean
branch
from
c7b029b to
0e8ad58
Compare
2 participants
This PR updates the Gemma3 notebook to use OpenVINO GenAI instead of the transformers library.
Changes Made
Files Changed
notebooks/gemma3/gemma3.ipynb- Main notebook updatesnotebooks/gemma3/gradio_helper.py- Gradio helper updatesnotebooks/gemma3/README.md- Documentation updatesTesting